Memory Capacity for Sequences in a Recurrent Network with Biological Constraints
نویسندگان
چکیده
منابع مشابه
Memory Capacity for Sequences in a Recurrent Network with Biological Constraints
The CA3 region of the hippocampus is a recurrent neural network that is essential for the storage and replay of sequences of patterns that represent behavioral events. Here we present a theoretical framework to calculate a sparsely connected network's capacity to store such sequences. As in CA3, only a limited subset of neurons in the network is active at any one time, pattern retrieval is subj...
متن کاملHandling Sequences with a Competitive Recurrent Network
The Competitive Recurrent Network presented is a neural network with competitive layers that is able to handle sequences of input patterns. The mechanism enabling the neural network to handle sequential aspects is a feedback loop. A modiied form of Hebbian learning is employed together with several types of forgetting. The updating mechanisms used have been developed speciically for the network...
متن کاملOligopoly with Capacity Constraints and Thresholds
Abstract Extended Oligopoly models will be introduced and examined in which the firms might face capacity limits, thresholds for minimal and maximal moves, and antitrust thresholds in the case of partial cooperation. Similar situation occurs when there is an additional cost of output adjustment, which is discontinuous at zero due to set-up costs. In these cases the payoff functions of the...
متن کاملPRNN: Recurrent Neural Network with Persistent Memory
Although Recurrent Neural Network (RNN) has been a powerful tool for modeling sequential data, its performance is inadequate when processing sequences with multiple patterns. In this paper, we address this challenge by introducing an external memory and constructing a novel persistent memory augmented RNN (term as PRNN) model. The PRNN model captures the principle patterns in training sequences...
متن کاملA Recurrent Neural Network Model for Solving Linear Semidefinite Programming
In this paper we solve a wide rang of Semidefinite Programming (SDP) Problem by using Recurrent Neural Networks (RNNs). SDP is an important numerical tool for analysis and synthesis in systems and control theory. First we reformulate the problem to a linear programming problem, second we reformulate it to a first order system of ordinary differential equations. Then a recurrent neural network...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Computation
سال: 2006
ISSN: 0899-7667,1530-888X
DOI: 10.1162/neco.2006.18.4.904